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ABSTRACT 

The purpose of the study vas to investigate the 
relationship between selected student characteristics, student 
involvement in learning, and achievenent. Both naturalistic (n « 28, 
27) and experiiental studies were conducted. In the experimental 
study, two classes (n « 29, 26) learned a sequence of matrix 
arithmetic by mastery learning strategies. The third class (n » 27) 
learned by more conventional strategies. A significant positive 
relationship vas found to exist between student involvement and 
selected student and environmental characteristics in both studies. 
On the final unit, the mastery learning classes scorod significantly 
higher than the conventional class on both student involvement in 
learning and achievement (p less than .001). (Author) 
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student Involveitic>nt In Learning and School Achievement 
Introductio n 

There is a theme which has been recurring consistently in educational 
writing during the past half century. This theme can be summarized in a 
single statement: learning is dependent on the behavior or Involvement of 
the learner. This belief has been stated in various forms by Morrison 
(1926) » Wheat (1931), Dewey (1938), Tyler (1950) » and Rothkopf (1970). As 
popular as this belief has been there has been very little research which 
has been conducted to test the appropriateness of this belief, particularly 
in a school learning situation. Rather, most recent research in education 
has been roncerned with investigating the relationship of teacher 
characteristics, teacher-student interactions, selected teaching methods 
and materials, and selected student characteristics (e.g., intelligence, 
school attitude, personality characteristics) directly to school learning 
or achievement. This study is an attempt to investigate this hypothesized 
relationship between student behaviors and learning. 

In his paper "A Model of School Learning," Carroll (1963) quantified 
student involvement In learning with the use of a single variable, time. 
Time, according to Carroll, was not "elapsed time" (the .time during which 
the student is in the presence of the instructor or instructional material): 
rather, time refers to the amount of time that the student is actively 
involved in learning. This latter amount of time is referred to in this 
paper as "time-on-task." . * 
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Carroll hypothesized several characteristics of the learner and the 
learning environment that affect the students' time-on-task. ..The learner 
characteristics are defined In terms /*f variables which are fairly stable 
(i.e.. highly resistant to change). Examples of these characteristics 
are Intelligence, aptitude, and motivation. ' 

More recently Bloom (1971) hypothesized three sets of variables which 
affect both the level of achievement attained and achievement variation. 
These three sets of variables are cognitive entry behaviors (CEB), affective 
entry characteristics (AEC), and quality of instruction (QI). In contrast 
to Carroll's variables, Bloom operationally defined the two sets of student 
characteristics (CEB. AEC) in terms of more learnable or alterable char- 
acteristics. 

Bajed on the writings of both Bloom and Carroll, time-on-task is 
hypothesized to be a mediating variable between the three classes of 
antecedent variables and achievement. 

The Model 

The purpose of this study is to investigate the following model. 

Insert Figure 1 About Here 

In words, the model states thai student characteristics (CEB, AEC) in 
a given learning environment (QI) are related to. and affect, the amount of 
time that a student spends on-task (TOT) which, in turn, is related to, 
and affects, the student's achievement (ACH). 
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Specifically, the study was conducted to Investigate the following 
three hypotheses; 

1. There is a positive relationship between student tlme-on-task and 
student achievement. 

.2. There Is a positive relationship between selected student and 
environmental characteristics and student tlme-on-task. 

.3. Students possessing more positive entering characteristics In a 
more adaptive learning environment will spend more of their time 
on-task and will show greater achievement than students possessing 
less positive entering characteristics In a less adaptive learning 
environment. 

Before moving to the actual experiment Itself one Important point must 

♦ 

be made* Tne change from the operational definition of student characteristics 
in stable terms to the operational definition of the characteristics in more 
learnable terms has great Implications for education^ If the model holds 
only when stable student characteristics are used as the antecedent variables, 
1t has little relevance for educational practice. Since there is relatively 
little hope of altering stable characteristics in a single course or even 
a series of courses (especially at later years in the student's school life), 
there is also little iiope of altering the amount of time the student spends 
on-task, and hence, the amount he learns. This leads us to the gloomy 
picture of the non-effects of school and schooling which seems to be some- 
what prevalent In much of educational thinking today* 

If, on the other hand, the student's entering characteristics can be 
defined In terms of specific cognltlvo pre-requisi tus and task or course- 
specific affect, the model holds great promise for explaining and controlling 
school learning. 
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Naturalistic and Experlniental Studies 

Two separate studies were undertaken to investigate the model. The 
first study was conducted in two naturally occurring classrooms. The 
second study was an experimental study. 

There were two main purposes of the naturalistic st^udy: to examine 
the assoclational relationships among the variables which, if present, 
would provide a basis for an experimental study; and, to facilitate the 
generalization of the results of the experimental study to naturally 
occurring classrooms. 

Subject Matter and Samples 

The samples used in the study were taken from a junior high school in 
a middle class suburb of a Midwestern metropolitan area. Mathematics was 
chosen as the subject matter for both sub-studies. 

The naturalistic study was conducted at two grade levels. One sample 
consisted of twenty-seven seventh grade arithmetic students. The second 
sample consisted of twenty-eiyht ninth grade algebra students. The two 
classrooms were chosen at random from all of the soventh and ninth grade 
classrooms in one junior high school. The arithmetic class V'/as taught a 
one-week unit on division and divisibility. The algebra class was .taught 
a one-week unit on simplicatlon of algebraic expressions. 

In the experimental study* thirty students were randomly selected from 
each of three time blocks during which eighth grade students were assigned 
to mathematics classes. One of the three treatment conditions was randomly 
assigned to each experimental c.lass. The students were taught a three unit 
sequence of programmed material in matrix arithmetic developed by Block (1970). 
^ Because of student absences during the duration of the study the three classes 



contained 29, 26, and 28 students who completed the entire experiment. 

Qperationalizing t he Model 

There are five variables in the model th&t need to be operationally 
defined: time-on-task, achievement, cognitive entry behaviors, affective 
entry characteristics, and quality of instruction. 

The major variable in the model is time-on-task. Time-on-task refers 
to the time during which the student is actively involved in learning. 
There are two sets of behaviors which are relevant to the active involvement 
of the students: an overt set and a covert set. In . other words, there are 
on-task behaviors {e.g. , writing) that aro, in fact, observable, and on- 
task behaviors (e.g., thinking) that are unobservable. Ideally, the 
time-on-task measure should include two components: an overt component and . 
a covert component.^ 

The first component of the time-on-task measure is a classroom observation 

instrument, An observer watches each student for a period of six seconds 

and codes his behavior as being on-task or off-task. On-task behaviors 

include physically attending to the task, writing (taking notes or v/orking 

on an assignment), or talking to a significant other about the task. The 

per cent of overt time-on-task was estimated by dividing the number of 

observations that the student was coded "on-task" by the total number of 

2 

observations of that student. 

The second component of the time-on-task measure is based on a stimulated 
recall technique developed by Bloom (1953). This technique involves having 
a tape recording made of a teacher presentation or classroom discussion. 
After the class period is over the tape is played for the students. The 
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tape is stopped at various points and the students are asked to write what 
they had been thinking at that point in time in the actual classroom situation. 
In a seatwork ^:ituation the procedure vvas modified since no verbal stimulus 
was present in the classroom, Periodically, the students were asked to 
stop working and write in a sentence or two what they were thinking just 
prior to being told to stop. The students' thoughts were then classified 
by judges as being relevant or Irrelevant to the task. 

The per cent of covert time-on-task was estimated by dividing the 
number of thoughts that were classified as task relevant by the total 
number of thoughts classified. 

Finally* the variable "tinie-on-taF>k" Is defined as the arithmetic 
average of the per cent of covert time-on-ta:>k and the per cent of overt 
time-on-task. Internal consistency reliabilities for this variable ranged 
from .71 to .86* 

The remaining four variables in the model are defined in slightly 
different v;ays In the two studies. I.n the naturalistic study the following 
operational definitions apply. 

Achievement is defined by the scores on a unit achievement test. The 
, test was constructed to.measure unit objectives at the knowledge, comprehension > 
and application levels of the cognitive taxonorqy (Bloom etaK , 1956), 
(r^^ - .85, .85). 

Cognitive entry behaviors (CE8) were measured by the scores on the 
prior chapter achievement test (r^^ - .86, .84). Affective entry characteristics 
(AEC) were measured by scores on the National Longitudinal Study of Mathematics 
.Ability Math Self-Concept Inventory (r^^ = JiO. .66), Quality of Instruction 

o 
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(QI) was measured by the students' responses to two questions concerning 
their perceptions of two aspects of instructional quality: the compre- 
hensability of the instructor's explanations, and the amount of reward 
or reinforcement received from the instructor. 

In the experimental study, achievement was measured by the scores on 
each unit's achievement test. Reliabilities ranged from .62 to .82. 

Cognitive entry behaviors (CEB) for each unit were measured by the 
achievement test scores on the prior unit. " Affective entry characteristics 
(AEC) were measured by a single question asking the student how interesting 
he thought the next unit would be. The students responded "on a five point 
scale from 1 (very boring) to 5 (very interesting). Quality of instruction 
(QI) was determined by the learning strategy to which the students were 
assigned. Mastery learning strategies were termed high quality of 
instruction while the more conventional strategy was termed low quality 
of instruction. 

The Design of the Studies 

The naturalistic study lasted five days. The procedure was the same 
in both the algebra and the arithmetic classes. On the first day the 
students were administered the AF.C and QI measures. The observer assumed 
his place on one side of the front of the classroom. Mo coding of behaviors 
was done the first day. The major purpose was to have the students become 
accustomed to having another adult in the room. On the second day the 
observation procedure was begun. Each class period consisted of approximately 
twenty, minutes, of teacher presentation followed'by thirty minutes of 



8 

seatwork. In the presentation portion the teachir presented new material, 
worked exaiTiples» and answered questions* This same procedure was continued 
for the next two days» The students were Instructed not to do any of 
their work at hoi^e* On the fifth day the achievement test was administered* 

In the experimental study the three classes learned under two 
different strategies. The first class learned by a mastery learning 
strategy (Block, 1970) In which the students were provided with Immediate 
feedback of results, corrective procedures, and additional time and help, 
if needed. All students in this class were helped to attain an 85 per 
cent level of mastery on each unit {85ML). 

The second class received the same learning strategy as the first except 
all students were helped to attain a 75 per cent mastery level on each 
unit (75ML). 

The third class received a more conventional learning strategy in 
which the students read the programmed text on each unit, were administered 
the test on that unit upon completion, and moved on to the next unit (CONV). 

All three classes read the first unit of the programmed texts- After 
each student had completed the reading he took the unit test. After the test 
was corrected, those students in the 75ML and 85ML classes who did not 
attain their appropriate per cent correct were given additional time and 
student tutorial help in order to correct their mistakes. After the students 
in the tv/o mastery classes corrected their mistakes, they were given a 
parallel review test containing the number of problems they had had Incorrect 
initially which, when completed correctly, would bring them up to the 
criterion leveh^ For example, suppose a ^student In the 75ML class * Initially 
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had 13 of the 20 items correct, I.e., 65 per cent. For his review test ho 
would be given two more problems. These two problems done correctly would 
bring him to the necessary 75 per cent mastery level. The CONV class was 
finished with the unit after the test was completed. The learning proceeded 
in the same manner for all three units. Each day one learning unit was 
given to the students. 

The major purpose of the experimental study was to investigate the 
third hypothesis. Since this is the case U is necessary to indlcatt the 
differences between the mastery learning and conventional classes on the 
relevant antecedent variables. 

The two classes differ in quality of instruction since the mastery 
learning class Is provided with immediate feedback and corrective procedures. 
Also the mastery learning classes are provided with additional time in 
the classroom so that the mistakes can be corrected. The conventional 
class has neither of the above characteristics. 

The cognitive entry behaviors of the students in the two groups differ 
because the mastery learning classes are required to attain a pre-set 
criterion level on each prior task .before going on to the next task in 
the sequence. This pre-set criterion level provides all students with a ' 
high level of the necessary cognitive pre-requisites for each successive 
task. The conventional class moves to the next task after a test over the 
previous task has been administered. Thus the conventional class is likely 
to have a lower mean score as well as greater variability on the measure of 
cognitive entry behaviors. 
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Finally, Block (1970) concluded that the 85 per cent level of inastery 
maximized the affective outcomes of the total unit. The implication is that 
in a sequence of learning tasks or units, the affective entry characteristics 
for each successive task or unit are higher for a relatively high criterion 
niaste>7 group than for a conveatlonal group. The conclusion is that after 
a series of tasks the two groups which were quite similar at the beginning 
of the sequence will be quite different In both cognitive and affective 
pre-requ1s1 tus for subsequent tasks. 

Results 

Because of the problems Involved in using per cents in formal statistical 
analysis, a logistic transformation v;as performed on the data before the 
analyses were computed. 

The first hypothesis was to determine if there exists a high associatlonal 
relationship between time-on-task and achievement. The findings with regard 
to this hypothesis are presented in Table 1. 

Insert Table 1 About Here 

The results indicate that this relationship does exist. The zero-order 

correlations between the two variables were highly significant in the threv«j 

samples (p<.01). It is of interest to note the similarity In the degree 

of the relationship in both the naturalistic samples and the control class 

of the experimental study. Further, a variance interp re tat 1(5^1 of the 
4 

corrected coefficients yields the finding that t1me-on-task accounts for 
betv/een one-half to two-thirds of the variation in achievement. 

The second hypothesis was to determine whe.ther there exists a high 
associatlonal relationship between relevant antecedent variable classes 



. arid tiitie-oh-ttsk, Tho results pert.alning to this hypothesis are presented 
:Ah Table 2." 

Insert Table 2 About Here 

\ . ■-, jMjerms of the zero-order correlations between each of the antecedent 
variables and t1nie-on,task» there was a sightficant correi,^tion^be*weejri., 
<^<^9'^^^1^f .?)itry behaviors and tlme-on-task in two of the three ^r'^pl.^^ J 

;The lack of a significant relationship in tho arithfuetic sample was beiieY$|^i 
to b$ a function of the apparent non-sequential nature of the $ubject!J^S> .:;. 
matter which questioned the* appropriateness of the measure of cognit1vr/;;^t^: 
entry behaviori selected. lff'tW6 of the three samples there was a sighlficartt 
correlation between the affective fntry characteristics measure and tim0A^>--< 
on- task. . ' ' ' ' 

Finally, in only one of the samples was the correlation between 
quality of instruction and time-on-task significant. This, however, was. 
the only sample in which quality of instruction was defined in terms of 
the instructional strategy to which the student was assigned. In both of 
the other samples the fneasure of quality of instruction was based on the 
students' perceptions of the instructional quality. 

When corrected nultiple correlations were used to investigate the 
relationship of the composite of the antecedent variables and time-on- 
task, the antecedent variables account for between 25 per cent and 67 per 
cent of the variation in time-on-task. Since, however, only one, or at 
most two, of the three antecedent variables could be corrected for attenuation 
befo^-e being placed in the multiple regression analysis It is believed that 
the findings' represent an' underestimate of the reTatlonship between the * 



M&-rWW^-' The third hypothosis was to determine the effect of high cognitive 
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ehtViP^behayiors, positive affective entry characteristics, and a highjley^il 
l^f im^ as compared tF low cognitive entry behl\'ior$H$ 



less positive affective entry characteristics, and lower quality of 
instruction on both time-on-task and achievement. 

In order to investigate the final hypothe$i!> the three classes were 
compared on the two criteria on the third unit. As a check on the iiiit^'ial 
similarities of the classes, however, the classe;;- were compared on the 
criteria on the initial unit. -All three classes wvre subjected to exactly 
the same treatment up to the administration of the initial test in unit 
one. All students had read the programmed text on their own and taken the 
unit test. This Initial comparison was a means of examining how similarly 
the classes functioned in Ithe same trfeatmeot situation. 

Table 3 presents the means, standard-deviations, and F-ratioS for 
per cent of time-on- task and original per cent correct for the three classes 
in both units one and three. ■. }:.J 
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Insert Table 3 About Here 



" ' There is not a significant difference in either per cent of time-on- U^C^V,-: 
task or original per cent correct after. the original amount of learning'ii ■ 
time in unit one. After the same initial learning experience the 6laS|^V..^rv- 
were approximately equal on the two criteria. - 

^|^^^g^|ipi|iiv/a¥^ 
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time-ort-task and original per cent correct as the criteria, The F-ratio 
for unit three (using Wllks Unibda crltorion) was 10. 3S (p < .001). 
Following the multivariate analysis of variance, the univariate F-tests 
were computed. Significant differerces were found among the classes on 
both time-on-task and achievement, 

Insert Table 4 About Here 

The orthogonal contrasts irt Table 4 help to better understand the ' 
nature of these differences. The differences of Interest were the 
difference between the two mastery learning classes (^5ML - 75ML) and the 
difference between the combined mastery learning. group and the conventional 
class ((85ML + 75ML)/2 - CONV). In. considering the contrasts, the same 
finding occurs whether time-on-task or achievement in the criterion. The 
contrast between the two mastery learning classes was not significant, 
However, the contrast between the combined jnastery learning group and 
conventional class was highly significant (p < .001). 

The nonsignificant difference of the two mastery learning classes 
requires further investigation. The two mastery classes differed from " ^ 
• the conventional class on all of the antecedent variables' for unit three. 
They differed in quality of instruction by definition. There was a sig- " 
nificant difference (p < .001) on the measure of cognitive entry behaviors. 
Finally, there was also a significant difference (p <.01) on the measure 
of affective entry characteristics. 

The two mastery classes themselves were not si gnific^intly different 
;;.;f;|ifi*6i^^ variables. The qualf^^^ririHri/0ffi)^i^l^#^ 

'saisr agtrii' irmfim. •Tk#6-?;as-nb 'l^fd^miJam^^trf^Y^nce - 




|0n the measure of affective entry characteristics. Flnairy. since sli^^'^^^^^"^^^^^^ 
M^b^n of the 75ML class attained scores higher than the t^equired 75 per i 
cont on the original unit two test the mean scores on the cognitive entry 1 
behavior measure were not significantly different. Thus, this nonsignificant 1 
mult lends additional support to the hypothesized model. . I 

Perhaps a graphic representation of the data will make the findings ^ 
conce.^ning the third hypothesis more clear. Th^ trend over the entire -m 
three task sequence Is seen in Figure 2. • 



Insert Fj gyre ; 2 About Here 
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In the conventional class both per cent time-on-task and per cent 
achievement decrease over the entire sequence of units. The time-on-task 
line and the achievement line ^re very close to par^allel for the conventional 
class. In the mastery group we see that both the pfer cent of time-on-ta^k . 
and the per cent achievement increase over the .$6quence of units, ^ 
While the increase in achievement from unit one to unit two appears quite 
small, the increase in time^on^task for these. t|vo units is more^tiXMVo 



This might indicate that unit two was^mornifficMlt than unit ortefi .e. ^-'the 4- 
students have to maintain a greater percentage of on-task time merely to V:.-:!- 
: attain the same level of achievement on the second unit as they did on the . 
>■■'- ■- first;." The third unit, by this reasoning, seems to be-easier sirt^e the 
achievement line shows a sharper Hse than does the time-on-task -line. In 
genei^dfr however. U'can be seen th^t a§ we mov.e from^'Wpff^f^iuft^^^^^ 
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■ v«ry strtTor U their learning on the co»^,rab1e learning task (task one) 
become Increasingly dUslmtlar as they progress toward the end of the 
sequence. . , , 

Con^u.s1pjis_a.niJfflpji^c^ 

Most of the conclusions and Implications of the study are derived 
from the results of the experimental study. An attempt was made to relate 
the findings to the naturalistic study when possible.. However, the/. - 
strength of the .»del on which this study Is based lies In the results of" 
the experimental study. 

Since this Is the case It Is Important to enumerate some ImpOrtantVvs 
limitations of this study. First, the experimental study was of very:^^"! 
Short duration and was an extremely controlled, structured situation.. " 
The entire study lasted approximately five hours over a one week period, 
The possibility Of generalizing to. leSs. structured classroom situations , 
extending over much longer periods of time must be carefully ex.^ollne*.'. , , 

The experimental study consisted of sequejtlal learning unllr in '' ■ 
the one situation (the arithmetic sample In the naturalUtlc study) In ^ 
Which the sequential quality of the course was uncertain,- the nxidel did ' 
net hold as well. Thus the general Izablllty of the results to non- 
sequehtfaV learning situations must be made with caution, ' . ' ' 
Despite these limitations the following conclusl.M-an'' 1™pHcHt1ons 
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, ^^^^^^ ^^^^^^ ^^^^^ 

p... 

antecedent vaHa.Us wMch a.e .Uted to. and affoct. tl™-on-ta.. 

<n .a^na... aUo.a.e c.^cte....:. ' 

the student. 

A n«Jor conclusion which follows fro. the exp.H.ental study .s that 

tu^l the state of schools as they cu.entiy exist, school lea.nin, 

.a 10. oan he set .p that can elthe. c.ate.o. dest.o. talent. ,„ , 
- Of h ^^^^^^^^ ^^^^ ^ . ^ . 

.asm,,. ™o. Of the. t1. on-tas. and achieve hl.he. test sco.es on 
; T"' .nits, m anothe. of.the expe.l^ntal lea.nih, situations 
Igt p;1hc.eas1n,ly les. of%l. ti.e on-t... and achieved , o„.. 
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With the above discussion in mind, one major implication that follows 
from the study concerns the importance of time-on-task as a critica l and 
alterable variable in school learning, and the parallelism whicfi 6xUts 
.betK^n timo-on-task and achievement. Put simply, as students -sl'dnd . 
of their time on-task they learn more. Since this is 'the case, time-on- . 
task can be viewed as, a criterion variable, in its own right. Teaching 'iV .f., 
effectiveness can.be evaluated whU^ learning is wcurrjng.^nd -nojt^ll^^ 
it has already occurred."" . . "'^n H'^;* J.^'-^^--^- ' ■- 

This study puts the effects of schoolingHn a quite different^ perspective 
from that of Coleman and, more recently, Oencks, (1972). Howev##f|^(!iis|^^ 
be noted that thislo pr6vious studies Werr- reports- of the way scfct^ ^^'-s^M-:. 
and school learning currently are,' Tfte "present studyj on the 6ther hand, " 
is a study of what schools can do. The emphasis ^is totally, different, . ' . 1 ■ 
While prior studies have tended to look at and possibly expliVrf iKe irW%|^^^^^^^^ 
m present experimental study has attempted to speculate on what rtiight . 



be possible. 



Footnotes 



' Thos. interesto. t„ . .oro de.cHptfon of the tl^o-on- 

task Instrurwnt ai-a nHmi to Anderson (1973), 

- ' Fo. the purposes of objectivity . second observer was brought into 
the Cassroo. per,od,c.ny, The per cent of observer a,ree«t In both 
studies ranged from 79 to 89 per cent. • 

' Again for the purposes of objectivity a complete set of the papers 
was given to the second Judge. The per o.nt of inter-judge agreement was 
approximately 89 per cent. 

' The correlations were corrected for attenuation. Since the purpose 
0 examining the correlations is to test a .del. both observed correlations 
an correlations corrected for attenuation are given. O'Connor (1972) and 
others reco«nd the practice of corrocting for attenuation when one "is 
interested in the relationship between the true scores of the variables" ' 

(Pr 76), _ ... . , y 

I The. significance of the increase and decrease In both tto-on-tasB 
n athleve^ent fro™ unit one to unit three was.tested by a corrdlltea^S:-^ 
t-test. Both the increase and decrease were •5lgS1f1cVnt-(p .oos). ' " 
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7fv.8 


12.5 


; 74.2 


18.9 


8SML 


82.4 


11.6 


. 75i$ 


13.9 



^^'^ ." -^J*.! .18.3 13.56***19.41*** 

. , . . , .... . . ...... .... . . , . ..... 



I.. per cont of tlho-onHask" roportdd . in this table Hs^^^^^^^ 

'f ■ K^I^'^'.f'^'' stKdonts wcro on-task In^ tL origJnar learning situa^lSr i^ • 

^^^'^''^ nastory classes received extra time and help. .''"^ ; , 

^^0§^m^SSSimt' ■' ^ iiiiiilliiii''-:^ ^: • \/-flfip§|piiil^ 



^iiiSWP^^^p:,™-.^... - ..- - - ■ ... .-. . -.,..„..,....,,,,..,.... 
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TAUM: 4 



jrthogonal Contrasts A^ong -SmL, and Conventional Groups 



: ■ " Value (Standard Hvror) 



or tho Contrast Jess than 

Timo-on-Task in Unit 3 



Original Acliiovomoiu in Unit 3 

fiSML - 7SML . ' 0 dlftm nftai 

#Ui\:;-::\(S5ML 4 75ML)/2 O»01,8[0.088] 



tisi 



- , • . . - . ■:-;:;-y^/r-:';'';"^\/..>\;\:-.---;s 




5 



1 




01 

o 
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